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Channel Uncertainty in Ultra Wideband 
Communication Systems 

Dana Porrat, David N. C. Tse and Serban Nacu 

Abstract 

Wide band systems operating over multipath channels may spread their power over bandwidth if 
they use duty cycle. Channel uncertainty limits the achievable data rates of power constrained wide 
band systems; Duty cycle transmission reduces the channel uncertainty because the receiver has to 
estimate the channel only when transmission takes place. The optimal choice of the fraction of time 
used for transmission depends on the spectral efficiency of the signal modulation. The general principle 
is demonstrated by comparing the channel conditions that allow different modulations to achieve the 
capacity in the limit. Direct sequence spread spectrum and pulse position modulation systems with duty 
cycle achieve the channel capacity, if the increase of the number of channel paths with the bandwidth 
is not too rapid. The higher spectral efficiency of the spread spectrum modulation lets it achieve the 
channel capacity in the limit, in environments where pulse position modulation with non-vanishing 
symbol time cannot be used because of the large number of channel paths. 

I. Introduction 

This work discusses the achievable data rates of systems with very wide bandwidths. Consid- 
ering communication with an average power constraint, the capacity of the multipath channel in 
the limit of infinite bandwidth is identical to the capacity of the additive white Gaussian noise 
(AWGN) channel Cawgn = P/No\oge, where P is the average received power (due to the 
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transmitted signal) and Nq is the received noise spectral density. Kennedy [1] and Gallager [2] 
proved this for fading channels using FSK signals with duty cycle transmission; Telatar & Tse [3] 
extended the proof for multipath channels with any number of paths. The AWGN capacity is 
achievable on multipath channels also by dividing the spectrum into many narrow bands and 
transmitting bursty signals separately on each band. 

When using spreading modulations, Medard & Gallager [4] show that direct sequence spread 
spectrum signals, when transmitted continuously (no duty cycle) over fading channels (that have 
a very large number of channel paths), approach zero data rate in the limit of infinite bandwidth. 
A similar result was shown by Subramanian & Hajek [5]. Telatar & Tse [3] show that over 
multipath channels, the data rate in the limit of infinite bandwidth is inversely proportional to 
the number of channel paths. 

This work is motivated by a recent surge in interest in ultra wide band systems, where spreading 
signals are often desired. It shows that under suitable conditions, spreading signals can achieve 
AWGN capacity on multipath channels in the limit of infinite bandwidth, if they are used with 
duty cycle. In other words, peakiness in time is sufficient to achieve AWGN capacity, and the 
transmitted signal does not have to be peaky in frequency as well. We analyze direct sequence 
spread spectrum (DSSS) and pulse position modulation (PPM) signals, and show that when the 
scaling of the number of channel paths is not too rapid, these signals achieve the capacity in 
the limit as the bandwidth grows large. DSSS signals with duty cycle were used by [6], that 
showed non-vanishing capacity in the limit. 

Our results can be seen as a middle ground between two previous results: 1. FSK with duty 
cycle achieves AWGN capacity for any number of channel paths and 2. direct sequence spread 
spectrum signals with continuous transmission (no duty cycle) have zero throughput in the limit, 
if the number of channel paths increases with the bandwidth. 

The effect of duty cycle can be understood in terms of the channel uncertainty a communication 
system faces. The data rate is penalized when the receiver has to estimate the channel, so 
infrequent usage of the channel leads to a small channel uncertainty and a small penalty. The 
spectral efficiency of the modulation scheme plays an important role in determining the channel 
uncertainty a system handles. A system with a low spectral efficiency can pack a small number 
of bits into each transmission period, and in order to maintain a high data rate it must transmit 
often. Thus, low spectral efficiency forces the communication system to estimate the channel 
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often, and suffer from a large penalty on its data rate. 
A useful intuition is gained from examining the ratio 

where L is the number of independent channel components, Tc is the coherence time and 9 is 
the duty cycle parameter or the fraction of time used for transmission. The channel uncertainty 
(per channel realization) depends linearly in our model on L, and normalizing it to unit time 
means dividing by the coherence time Tc and multiplying by the fraction of time used for 
communication. We thus see that SNRcst compares the channel uncertainty per unit time 
to the data rate in the limit of infinite bandwidth that is proportional to The ratio SNRest 
can also be interpreted as the effective SNR per path for channel estimation. A communication 
system can achieve the channel capacity in the limit of infinite bandwidth if channel estimation 
in the limit is perfect, and this requires 

SNRest — > oo 

In systems with bounded average received power, the duty cycle parameter must diminish in 
order to balance the increase in the number of channel components L, and let the overall 
channel uncertainty diminish. This work examines the conditions that allow this situation in 
the limit, for two different modulations with different spectral efficiencies. The combination of 
the requirements for diminishing channel uncertainty {9L — > 0) and sufficient transmitted bit 
rate determines the conditions that allow the data rate to converge to the channel capacity in the 
limit, for systems where the receiver knows the path delays but not their gains. The requirement 
for sufficient data rate relates the bandwidth W to the duty cycle parameter, and depends on 
the spectral efficiency of the modulation scheme. Spectrally efficient modulation schemes permit 
infrequent transmission (or small 9), thus reducing the channel uncertainty per unit time. In 
contrast, low spectral efficiency forces frequent transmission, and the duty cycle parameter must 
stay high. 

The difference between the wideband capacities of DSSS and PPM schemes comes about 
precisely because of their different spectral efficiencies. PPM is an orthogonal modulation, so 
the number of bits it can transmit per unit time increases only logarithmically with the bandwidth, 
where the number of bits a DSSS transmitter can send per unit time increases linearly. Thus, 
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Fig. 1. Number of significant ctiannel pattis vs. bandwidth. The paths accounting for 60-90 percent of the energy were counted 
in two separate measurement campaigns. The Intel data were taken from [7] and the Time Domain data from [8] 

DSSS can tolerate a larger amount of channel uncertainty than PPM. Note that, in contrast, both 
PPM and DSSS achieve the channel capacity in the limit of infinite bandwidth over the AWGN 
channel as well as over the multipath fading channel where the channel is known to the receiver. 

Our main results are as follows. In the limit of infinite bandwidth, DSSS systems where the 
receiver knows the path delays achieve AWGN capacity if the number of channel path is sub- 
linear in the bandwidth, formally if ^ where L is the number of independently fading 
channel paths and W is the bandwidth, and the system uses an appropriate duty cycle. PPM 
systems too can achieve AWGN capacity in the limit of infinite bandwidth, but this is possible 
for smaller number of channel paths. A PPM system with a receiver that knows the path delays 
achieves AWGN capacity if j^^^ — > 0. PPM systems with lower bounded symbol time have 
zero throughput if ^ oo. In systems where the receiver does not know the path gains 
or delays, we show that DSSS systems can achieve AWGN capacity if ^ — > as the 
bandwidth increases. Measurements of the number of channel paths vs. bandwidth in Figure 1 
show an increase of the number of channel paths that appears to be sub-linear. 

It is interesting to contrast our results with those of Verdu [9], where the crucial role of 
peakiness in time is pointed out and a connection is also made between the spectral efficiency 
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of a modulation scheme and its data rate over a large bandwidth. The theory there analyzes the 
capacity of channels with fixed channel uncertainty as the average received power per degree 
of freedom goes to zero (or, equivalently, the bandwidth goes to infinity). By suitable scaling 
of the duty cycle, the infinite bandwidth AWGN capacity is always approached in the limit 
by the modulation schemes considered there, and the issue is the rate of convergence to that 
limit. This rate of convergence depends on the spectral efficiency of the modulation scheme. In 
contrast, the environment considered here is a harsher one, in that the channel uncertainty (or 
the number of channel parameters) increases with the bandwidth. Now the issue is whether a 
modulation scheme approaches the AWGN capacity at all. The framework in [9] is suitable for 
systems that break the wideband channel into many parallel narrow-band channels; one example 
is the orthogonal frequency division multiplexing (OFDM) modulation. In this context, one can 
focus on a single narrowband channel, in which the channel uncertainty is fixed. The channel 
uncertainty faced by an OFDM system depends on the number of such parallel channels, it does 
not depend on the number of channel paths L. 

Analysis of the zero SNR limit over a narrowband channel is also offered by Zheng et al. 
In [10], [11] they analyze the channel uncertainty penalty of narrowband systems in the limit of 
diminishing SNR. The concept of SNR per degree of freedom of the channel is central in these 
analyses, that are based on the connection between the coherence time and the SNR per degree 
of freedom. In the narrowband setup, each degree of freedom of the channel is a single (scalar) 
channel realization. The longer the coherence time, the more energy is transmitted per block, 
thus the SNR per degree of freedom increases and estimation of the (scalar) channel improves 
accordingly. 

The outline of the paper is as follows. After presenting the channel model and the signals 
in Section n, a summary of the results is presented in Section III and discussion is brought 
in Section IV. Section V presents a bound on the channel uncertainty penalty related to path 

delays. Sections VI and VII then present bounds on the data rates of DSSS and PPM system 
where the receiver knows the channel path delays. 
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II. Channel Model and Signal Modulations 

The natural model for an ultra wide band channel is real, because there is no obvious 'carrier 
frequency' that defines the phase of complex quantities. The channel is composed of L paths: 

L 

Y{t) ^Y.Mt)Xit - di{t)) + Z{t) 

1=1 

The received signal Y{t) is match filtered and sampled at a rate 1/W, where W is the bandwidth 
of the transmitted signal, yielding a discrete representation of the received signal. We assume 
a block fading model: the channel remains constant over coherence periods that last Tc, and 
changes independently between coherence periods. The paths' delays {di}f^^ are in the range 
[0, Trf), where is the delay spread. The channel is assumed under-spread, so the delay spread 
Td is much smaller than the coherence period, and signal spillover from one coherence period to 
the next is negligible. Considering a double sided noise density ^ the discretized and normalized 
signal is given by 

Yi^jY^JL'^rnXi-rrr. + Zi Z = 0,...,LWJ -1 (1) 

m=l 

with £ = = 2LSNRcst and = [TcW\. The noise {Zi} is real and Gaussian, and the 
normalization requires that the path gains {A^} and the transmitted signal {Xj,} are scaled so that 
E AmXi^m)"^ — 1. We assume that {Am} are independent and zero mean, thus the scaling 
requirement is Yl^ [A^] — 1 and E [Xf] — 1. This normalization ensures that E[Zf] — 1. P 
is the average received power and W is the bandwidth. In practical systems, where the channel 
response is dispersive, the bandwidth of the received signal is larger than the bandwidth of the 
transmitted signal. We do not consider this difference in the channel model. 

In order to avoid complications at the edge of the coherence interval, we approximate the 
channel using a cyclic difference over Kc instead of a simple difference: (n) = n mod Kc. The 
difference is negligible as the delay spread is much smaller than the coherence time. 

= ^™^(--"') + i = 0, . . . , LWJ - 1 (2) 

^ ^ m=l 

Note that when X is a PPM signal described in Section II-B (that includes a guard time 
ensuring a silence period between symbols) the circular formulation (2) is identical to the original 
model (1). 
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The path delays {t„i} are grouped into resolvable paths, separated by the system time reso- 
lution The resolvable paths are defined by summing over the paths with similar delays: 

Gi^ J2 Am < / < lTdW\ 

The number of resolvable paths is L and their delays {Di}^'^^ are integers between and 
[M^Tj^J —1. The L delays are uniformly distributed over the ('-^/^^-') possibilities of combinations 
of L values out of {^^^'^^) positions. 

= \fw Yl GiXi.n, + Zi i = 0, . . . , IT,W} - 1 
V 1=1 

The channel gains are real, we assume that they are IID and independent of the delays. Our 
normalization requires that the variance of the gains equals j^. 

The systems we consider do not use channel information at the transmitter, and the receiver 
knows the deterministic features of the channel, namely the coherence time Tc, the delay spread 
and the number of paths L. The receiver sometimes has additional knowledge, about the 
random features of the channel, in particular the path delays D. The assumptions on receiver 
knowledge of the channel are explicitly stated throughout the paper. 

The assumptions we make of IID paths that compose the channel ensure that the channel 
uncertainty is linearly dependent on the number of paths L. Our results essentially compare the 
communication data rate to the information (number of bits) needed to describe the channel. 
Complex channel models, with non-uniform paths, require more delicate analysis to evaluate the 
channel uncertainty penalty. 



A. Direct Sequence Spread Spectrum Signals 

Each transmitted symbol contains a random 
zero mean, and an energy constraint is satisfied 



Each transmitted symbol contains a random series of IID Kc Gaussian values {rjj^Q ^ with 



E [Xf] = 0E 



1 



where < < 1 is the duty cycle parameter or the fraction of time used for transmission. 
The symbol r is used for the transmitted signal during active transmission periods, while X 
represents all of the transmitted signal, that includes silent periods due to duty cycle. The duty 
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Fig. 2. Direct sequence spread spectrum with duty cycle over coherence periods. The duty cycle parameter 9 equals the 
fraction of time used for transmission. The receiver is aware of the active periods of transmission. 



cycle, with parameter 9, is used over coherence times: of each period one period of T^. is 
used for transmission and in the rest of the time the transmitter is silent (Figure 2). We define 
the sample autocorrelation of the signal 

e 

C{m, n) = — ^ Ti^rnTi-n Vm, n 

Edge conditions are settled by assuming that the each symbol follows a similar and independent 
one. Under the assumption of IID chips we have 

^ ^ 2L L"^ — L 

y2y^E,\C{m,n)-5mn\<^= + —rr- (3) 

m=l n=l * 

see the proof in the appendix. 

The upper bound on DSSS capacity (Section VI-B) is also valid for another type of signals, 
where x is composed of pseudo-random sequences of Kc values. The empirical autocorrelation 
of the input is bounded and the signal has a delta-like autocorrelation: 

\C{m,n) - 5{n,m)\ < — (4) 

Kc 

where d does not depend on the bandwidth. 
B. PPM Signals 

The signals defined in this section are used to calculate lower bounds on the data rates of 
PPM systems (Section VITA). The upper bound on PPM performance holds for a wider family 
of signals, defined in Section VITB. 
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Fig. 3. PPM symbol timing. 



Signaling is done over periods Tg long, with [T^H^J positions in each symbol, as illustrated 
in Figure 3. A guard time of is taken between the symbols, so the symbol period is Tg + T^. 
The symbol time Tg is typically in the order of the delay spread or smaller. It does not play a 
significant role in the results. The transmitted signal over a single coherence period is 



■\/W {Tg + Td) one position of each group of [T^H^J 

with n[{Ts+Td)W\ <i<n[{T,+Td)W\ + [T,W\-l 



n 



0,1,..., 



- 1 



other positions 

z = o,i,...,Lwj -1 



The number of symbols transmitted over a single coherence period is N 



. We assume 



N is a whole number, this assumption does not alter the results we prove here. The duty cycle 
parameter < < 1 is used over coherence periods: of each period one period of Tc is used 
for transmission and in the rest of the time the transmitter is silent. 



III. Summary of the Results 

A direct sequence spread spectrum system with receiver knowledge of the path delays, can 
tolerate a sub-linear increase of the number of paths with the bandwidth, and achieve AWGN 
capacity (Section VI-A.l). Conversely, if the number of paths increases linearly with the band- 
width, the data rate is penalized (Sections VI-B). 

Theorem 1: Part 1: DSSS systems with duty cycle where the receiver knows the path 
delays (but not necessarily their gains) achieve Cdsss ^ C'awgn as 1^ — > oo if ^ — > 0. 
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Part 2: DSSS systems with duty cycle achieve Cdsss C'awgn as — > cxd if ^^"^'^ 0. 
No knowledge of the channel is required. 

Converse 1: DSSS systems with duty cycle where the path gains are unknown to the receiver 
and uniformly bounded by < ^ with a constant B, achieve Cdsss < Cawgn in the limit 
1^ — > oo if ^ ^ a and o; > 0. This bound holds whether the receiver knows the path delays 
or it does not. 

The proof is presented in Section VI. 

Theorem 2: PPM systems with duty cycle, where the receiver knows the path delays, achieve 
CppM Cawgn as ^ oo if j^^p ^ and the path gains {Gi}^^^ satisfy (A) maxi<j<i, IG^I ^ 
in probability as L — > oo, and (B) Eq = E»=i 1 in probability as L — > oo. Note that if 

the gains are Gaussian IID with zero mean then the above condition holds. 

Converse 2: PPM systems with a non-vanishing symbol time, transmitting over a channel 
with Gaussian path gains that are unknown to the receiver, achieve CppM ^ as — > oo if 
j^l^ — > oo. This result holds whether the receiver knows the path delays or it does not. 
The proof is presented in Section VII. 

IV. Discussion 

This section presents bounds on the data rates of direct sequence spread spectrum and PPM 
systems for different channels, computed in Sections V, VI, and Vn. The channel and system 
parameters were chosen to represent a realistic low SNR ultra wide band system. For the figures 
with fixed bandwidth we use: Bandwidth 1^=20 GHz, ^=53 dB (SNR=-50 dB at W=20 GHz), 
coherence period Tc=0. 1 msec, delay spread Td=200 nsec, PPM symbol time rs=800 nsec with 
guard time of 200 nsec between symbols, and B'^d — 1. The constant B is defined in the 
converse to Theorem 1, it is used to characterize channel gains. The constant d is defined in (4) 
for pseudo-random chips; it equals 1 for IID chips. For the figures with a fixed number of paths 
we use L=100. 

A. The Advantage of Duty Cycle 

Figure 4 shows the increase of data rate given by the usage of coherence period duty cycle, for 
DSSS systems. The figure compares the upper bound on DSSS throughput, where duty cycle is 
not used (bottom graph) to the lower bound on throughput when optimal duty cycle is used. Both 
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Fig. 4. DSSS throughput bounds, the receiver does not know the channel gains nor the delays, vs. the number of channel 
paths. This plot contrasts an upper bound on DSSS data rate, when duty cycle is not used (bottom graph, from (17)) with a 
lower bound on the data rate when coherence period duty cycle is used (top graph, from (12)). Cawgn is shown for reference. 

bounds decrease as the number of paths L increases because the channel uncertainty increases 
as L increases, and so does the penahy on the data rate. 

B. The Duty Cycle Parameter 

Figure 5 shows the lower bound on the data rate of a direct sequence spread spectrum system 
for different duty cycle parameter values. The bound is a difference between the data rate of a 
system with perfect channel knowledge at the receiver and the channel uncertainty penalty (gain 
penalty and delay penalty). The data rate of a system with perfect channel knowledge equals the 
channel capacity (Cawgn) in the limit of infinite bandwidth, it is lower when the bandwidth is 
finite. 

The channel uncertainty penalty is small for low values of duty cycle parameter, because 
the channel is used less often as decreases. However, the data rate of a system with perfect 
channel knowledge is severely reduced if 6 is too low. In this case, transmission occurs with 
high energy per symbol, where the direct sequence spread spectrum modulation is no longer 
spectrally efficient, so the data rate with perfect channel knowledge is reduced. Figure 5 shows 
that the duty cycle parameter must be chosen to balance the channel uncertainty penalty (that is 
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Fig. 5. DSSS throughput lower bound vs. duty cycle parameter, the receiver does not know the channel path gains nor the 
delays. The bottom curve shows an upper bound on the channel uncertainty penalty (calculated as the sum of (7) and (5)). The 
dashed curve shows a lower bound on the system throughput (12), and the top (full) curve shows the throughput of a system 
with perfect channel knowledge at the receiver (10). Cawgn is shown at the dotted curve for reference. The system throughput 
(dashed curve) is the difference between the data rate of a system with perfect channel knowledge at the receiver (top curve) and 
the channel uncertainty penalty (bottom curve). The throughput is maximized when the spectral efficiency is balanced against 
the channel uncertainty penalty. 

large for large 9) and the spectral efficiency of the selected modulation, that increases with 6. 
C. Spectral Efficiency 

Figure 6 contrasts the achievable data rates of DSSS and PPM systems, when both use duty 
cycle on coherence periods with optimal duty cycle parameters. Direct sequence spread spectrum 
achieves higher data rates because it has a higher spectral efficiency, thus it can pack more bits 
into each transmission period of length Tc. By packing bits efficiently a DSSS system is able 
to use a small duty cycle parameter. In contrast, PPM is less efficient in packing bits into 
its transmission periods, and is thus forced to transmit more often (it has a larger duty cycle 
parameter. Figure 7). The PPM system is therefore forced to handle a larger number of channel 
realizations (per unit time), so it suffers a higher penalty for estimating the channel parameters. 

Spectral efficiency, in units of [j^^] , measures the number of bits that can be communicated 
per unit time per unit bandwidth. The number of bits per DSSS symbol depends linearly on the 
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Fig. 6. DSSS and PPM throughput bounds. The DSSS lower bound (12) is calculated without channel knowledge at the 
receiver. The PPM upper bound (25) is calculated with a receiver that knows the channel delays but not the gains, coherence 
period duty cycle is used. Cawgn is shown for reference. 



bandwidth, thus its spectral efficiency does not depend on the bandwidth. The number of bits 
per PPM symbol (with a fixed symbol time) depends logarithmically on the bandwidth, because 
PPM is an orthogonal modulation. Thus, the PPM spectral efficiency depends on the bandwidth 
via ^^^^ and is much lower than the DSSS spectral efficiency if the bandwidth is large. 

V. Channel Uncertainty Penalty 

The mutual information between the transmitted and the received signals is decomposed into 
the mutual information where the channel is known and a penalty term: 

/(X; Y) = I{X- Y\D, G) - /(X; D, G\Y) 

where /(X; D, G\Y) is the channel uncertainty penalty. This can be decomposed: 

/(X; D, G\Y) = /(X; D\Y) + /(X; G\D, Y) 

where I{X;D\Y) is the delay uncertainty penalty and I{X;G\D,Y) is the gain uncertainty 
penalty when the delays are known. 

The delay uncertainty penalty is upper bounded by the entropy of the path delays. The L path 
delays are uniformly distributed over the {^^j^"^^) possibilities of combinations of L values out 
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Fig. 7. Throughput bounds vs. duty cycle parameter, the receiver knows the channel path delays but not the gains. DSSS 
throughput lower bound (12) is maximized at a lower duty cycle parameter than the PPM upper bound (25). 



of WTd positions spanning the delay spread. 



I{X;D\Y) < H{D) < — logAWT, 



bits 



sec 



(5) 



and the gain uncertainty penalty when the delays are known is upper bounded (for DSSS 
signaling) by 

I{X;G\Y,D) < I{G-Y\X,D) < ^log, (l 



2Tr 



L 



sec 



see (11) for the derivation. 



VI. Spread Spectrum Bounds 

A. When is the Channel Capacity Achieved? 

We start with a result in the case of known path delays (Theorem 1 Part 1) that shows that 
the channel capacity is achieved if the number of paths is sub-linear with the bandwidth. A 
second result is then given for the case of unknown channel, (Theorem 1 Part 2), that shows 
that the channel capacity is still achievable, but at simpler environment, with a smaller number 
of channel paths. 
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1 ) Path Delays Known to Receiver: 

Theorem 1: Part 1: Direct sequence spread spectrum systems with duty cycle, where the 
receiver knows the path delays, achieve Cdsss C'awgn as 1^ — > oo if ^ — > 0. 
Proof: The proof is based on a lower bound on the mutual information. 
Proposition 3: DSSS systems where the receiver knows the channel path delays achieve 

I{X-Y\D) [b/s] >Cawgn (6) 

. \ ei ^ / p T,\ 

— mm < logo 1 H H 7, logn e 

Discussion of Proposition 3: The channel uncertainty penalty (due to path gains) has two 
parts, the first 

is the penalty due to the unknown gains, it increases as the number of paths L or the duty cycle 
parameter 9 increase. 

The second part of the penalty 



N^ew 



is due to the limitation on spectral efficiency of the spread spectrum modulation. It penalizes 
the system for using a too small duty cycle parameter, where the system concentrates too much 
energy on each transmitted symbol. Mathematically, this term is the quadratic term in the series 
approximating the mutual information, that is logarithmic. The first (linear) term in this series 
equals Cawgn in the limit. The balance between the two penalties is shown in Figure 5. 

Looking at the limit of infinite bandwidth, the data rate converges to the AWGN capacity if 
9W — > 00 and 9L — > 0. If L is sub-linear is W, these two requirements can be met simultane- 
ously, that is, there exists a duty cycle parameter 9, that depends on the bandwidth, such that 
9L and 9W 00. Thus, the proof of Theorem 1 Part 1 follows from Proposition 3. 

Proof of Proposition 3: The proof of (6) follows Theorem 3 of [3], with a real channel instead 
of the complex channel used there. We start from 

I{X; Y\D) = I{X; Y\G, D) - I{X; G\Y, D) 

where the second summand is the gain uncertainty penalty with known delays. By lower bounding 
this penalty: 

I{X] G\Y, D) = I{G] Y\X, D) - I{G; Y\D) < I{Y;X\D) (8) 
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we get 



The first part of (9): 



I{X- Y\D) > I{Y; X\G, D) - /(F; G\X, D) (9) 



I{Y-X\G,D) = ^EG,D\ogdei { I + ^AA 

where A is a Kc x Kc matrix, Aim = Gi if m = {i — Di) and zero otherwise, and £ = 
The eigenvalues of AA* are 



f(^)| , A; = 0,l,...,i^e-1, and 

L 

F{f) = J2GieM'^^jDif) 



1=1 



For large L ( ^ 1) F{f) is complex Gaussian with independent real and imaginary parts that 
may have different variances (for small /), so Eq — 1 and Eq < 3. 



I{Y;X\G,D) 



> 



^Eg,d 

WTc-l 
. k=0 

loge 
1 £2 



S 



WTr. 



k 



'WTc-l 
. A:=0 



£ 



WTr 



k 



2 W^T^ 



£ ?,£^ 
> — log e log e 



loge 



loge 



and In [bits/sec] units: 



mX\G,D) > -log,e 



logae 



where we used log(l -\- x) > ~ ^^S^' that is valid for x > 0. 
The second part of (9): 

/(r ; G\X, D) < ^Ex,D log det (l + i^BKB 



(10) 
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where = -^(i-m) and A = j^I. The upper bound is tight for Gaussian channel gains. Fol- 
lowing [3] we get an upper bound 



I{Y;G\X,D) <^\og(l + ^] (11) 



Rewriting (9): 



2 ° V L 



I{X;Y\D) > I{Y;X\G,D) - I{Y;G\X,D) 

E L ( E 

- 2^"Se-:^loge--logh+- 



in [bits/sec]: 

9I{X;Y\D) 



I(X;Y\D) [h/s] = 



c 



^ 9E ^ 91 ^ E 

WE"^ , 

log2 e 



log2 e-— logs 1 + 



3P2 



logge 



The bound is valid for any 9, and we choose its maximal value: 

I{X;Y\D) [b/s] > 

max l^logne 

o<e<i \ No ^ 



9£ f P 2Te\ P^ 
2T, V Nq9l) Nl9W 



— C'awgn 



. , 9L , / P 2T, , 
min <^ — log2 1 + irriTF + TTTZTU log2 e 



o<e<i 1 2Te ''^ V Nq9L J N^9W 



2) Path Delays Unknown to Receiver: 

Theorem 1: Part 2: DSSS systems with duty cycle achieve Cdsss — ^ C'awgn as — > oo 

■f LlogW rv 

Proof: The proof is based on Proposition 3 and equation (5) that relates the mutual 
information in the case of channel knowledge of the path delays with the mutual information in 
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the general case. With no channel knowledge at the receiver (path delays and gains unknown), 
we get: 



The third penalty term describes the penalty due to path delays, from (5). This term is a bound 

on the penalty, that depends linearly on the number of path delays per unit time. 
At the limit of infinite bandwidth the bound equals the AWGN capacity if 

. ew^oo 

. ^LlogW^^O 

The second condition may be dropped, as the third is stronger. These conditions can be met 
simultaneously, that is, there exists a duty cycle parameter 9 that depends on the bandwidth and 
satisfies the conditions, if L log W is sub-linear in W, namely ^'^'^ ^0. ■ 

B. When is the Channel Capacity Not Achieved? 

An additional assumption on gains is used in this section: the gains are uniformly upper 
bounded by IG^I < this is a technical condition that follows [3]. 

Converse to Theorem 1: DSSS systems with duty cycle where the path gains are unknown to 
the receiver and uniformly bounded by \Gi\ < with a constant B, achieve Cdsss < C'awgn 
in the limit 1^ ^ oo if ^ ^ a and a > 0. This bound holds whether the receiver knows the 
path delays or it does not. 

Proof: We first note that the mutual information in a system where the receiver knows the 
path delays upper bounds the mutual information in the general case: 



So we only need to prove the theorem regarding the conditional mutual information, where the 
receiver knows the path delays. 

The proof is based on the following upper bound on the mutual information. 



I{X;Y) [b/s] > Cawgn 



(12) 




I{X; Y) = I{X; Y\D) - I{D; X\Y) < I{X; Y\D) 
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Proposition 4: DSSS systems with duty cycle parameter 9 achieve 




(13) 



If the duty cycle is chosen so that — > oo as 1^ — > oo, then a second upper bound holds in 
the limit: 



d is defined in (4) for pseudo-random chips. For ED chips, the bound holds with d—1. 

Discussion of Proposition 4: We now look at two different possibilities regarding the duty 
cycle parameter 6: 

• 9W < oo. In this case the bound (13) is strictly lower than Cawgn- 

• 9W — > oo (as 1^ — > oo). Using our assumption on the number of channel paths we get 
9L oo, so the second bound (14) becomes relevant. In situations where <^ Tc, this 
bound is significantly lower than the AWGN capacity. 

If the number of paths is sub-linear in W, the duty cycle can be chosen so that 9W oo 
and 6'L — > and the bounds in (14) become irrelevant. In this case the upper bound converges 
to Cawgn in the limit of infinite bandwidth. 

To summarize the behavior of the bound in the limit, in the case of a linear increase of 
the number of paths with the bandwidth, the upper bound is lower than the AWGN capacity 
in normal operating conditions (7^ <^ Tc). The upper bound equals Cawgn in the case of a 
sub-linear increase of the number of paths with the bandwidth. 

Proof of Proposition 4 We start with a simple bound: 



This is the capacity of an AWGN channel used with duty cycle 9. It upper bounds the data rate 
for systems with channel knowledge at the receiver. In order to achieve the capacity at the limit 
of infinite bandwidth, the duty cycle parameter must be chosen so that 9W — > oo. 

To prove (14) we follow Theorem 2 of [3], that gives an upper bound on the mutual infor- 
mation. 



I{X;Y\D) [b/s] < Cawgn 



Tc 



(14) 
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+2S—Ed 



L L 



1=1 m=l 



where G and H are identically distributed and independent, \Hi\ < 
The first part of (15): 

L 



log Eh exp 



1=1 



log E\H\E^ exp 



1=1 



The phases {V^/} equal or tt with probability 1/2. 



i^O _ g +g 1 + ^ fora<l 



EiH\E^ex.p 



2 2 

L 

1=1 



<E\H\l[{l + 2£'\m\'\Gi\') 



(15) 



and the condition is <^ 1, which holds if — > oo. 



Eg log exp 



1=1 



< EGlogE\Hil[{l + 2S^\Hi\^\Gi\') 



1=1 



Using Jensen's inequality: 



Eg log exp 



2£Y,HiGi 



1=1 



<Y,^og{l + E\GMm2E^m'\Gi\^) 
28^' 



1=1 

L 



= ^log 1 + 



1=1 



LXog 1 + 



L2 

2£^ 
1? 
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2PTc . 

Noe • 



Ec log I Eh exp 



[ 1=1 



The second part of (15): 
• For IID chips: Using (3) 



2S—Ed 



< 28— Ed 



L L 
1=1 m=l 

3L 



H — I log2 e 



2£B'^ 
2SB^L 



3 ^-1',, 
+ 1 log2 e 



logae 



for L > 1 



The last inequality follows from L < T^W . 
• For pseudo-random chips: 



B^ 
2£—Ed 



L L 



1=1 m=l 



< 2£B^L—\og,,e 



APL 

N^ew 



B^d\og2 e 



< 



APT, 



d r>2 



B'^d log2 e 



log2 



log2 



so (16) is valid in both cases of input signals, and for IID chips we take d 
Putting the two parts back into (15): 



Qp2rp2 APT 

nX;Y\D) < -—^loge + —^B'd\og,e 
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In units of [bits/sec]: 



Qp2T-i APT 

I{X; Y\D) [b/s] < ^ log, e + -j;^^B'd\og, e (17) 



Using 6'L ^ oo we get 



APT 9T H d 

I{X-Y\D) [b/s] < "^B^dlog.e^C^^Gn ' 



c 



VII. PPM Bounds 
A. When is the Channel Capacity Achieved? (Path Delays Known to Receiver) 

Theorem 2: PPM systems with duty cycle, where the receiver knows the path delays, achieve 
CppM Cawgn as ^ oo if and the path gains satisfy (A) maxi<j<i ^ 

in probability as L — > oo, and (B) Eq = E»=i 1 in probability as L — > oo. Note that if 

the gains are Gaussian then the above conditions hold. 

Proof: We start by breaking the mutual information in two parts: 

I{X- Y\D) > I{X; Y\G, D) - I{Y; G\X, D) (18) 

The maximal data rate achievable by systems that use the PPM signals defined in Section II-B 
is the maximum of (18) over the duty cycle parameter 9. 

CpPM = max/(X;F|D) 



> max[I{X;Y\G,D) - I{Y;G\X,D)] (19) 

9 

The first part of (19) describes the throughput of a system that knows the channel perfectly. 
Section Vn-A.2 shows that it approaches Cawgn if the duty cycle parameter 9 is chosen 
appropriately. This result is shown by demonstrating that the probability of error diminishes 
as the bandwidth increases while the data rate is as close to Cawgn as desired. Our analysis 
shows not only that the probability of error diminishes, it also demonstrates a specific reception 
technique, showing achievability of the capacity in the limit. Section VII-A.l calculates the 
penalty on the system for its channel gain knowledge and shows that it diminishes for our 
choice of duty cycle parameter 9. 

The receiver we use in the analysis of probability of error is based on a matched filter, it is 
derived from the optimal (maximum likelihood) receiver in the case of a channel with a single 
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Received Symbol 




Matched Filte 



Fig. 8. A received symbol and the matched filter showing a partial overlap. 



path. PPM signals are composed of orthogonal symbols. When a PPM signal is transmitted over 
an impulsive (single path) channel, the orthogonality of the symbols is maintained at the receiver 
side. 

Considering a multipath channel, the received symbol values are no longer orthogonal, so the 
matched filter receiver is no longer optimal. The non-orthogonality of the received symbols has 
an adverse effect on receiver performance. As the number of channel paths increases, the received 
symbols become increasingly non-orthogonal, and the receiver performance is degraded. The 
matched filter receiver can sustain a growth of the number of channel paths (as the bandwidth 
increases), but this growth must not be too rapid. To put it more formally, our system achieves 
the channel capacity in the limit of infinite bandwidth, if the number of paths obeys — > 0. 

For each possible transmitted symbol value, the receiver matches the signal with a filter that has 
L fingers at the right delays (Figure 8). The receiver is essentially of the rate type, it constitutes 
a matched filter to the received signal, that depends on the (known) channel. The receiver uses 
a threshold parameter A — a^JS-jN for deciding on the transmitted value. If one output only is 
above A, the input is guessed according to this output. If none of the outputs pass A, or there 
are two or more that do, an error is declared. 
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We calculate an upper bound on the probability of error of this system, and show that it 
converges to zero as the bandwidth increases, if the number of channel paths does not increase 
too rapidly, namely ^ — > 0, and the duty cycle parameter is chosen properly. 

The second part of (19) describes a penalty due to unknown path gains, it is analyzed separately 
in Section VII-A.l, the upper bound calculated there does not depend on the coding used by the 
transmitter, and it diminishes as the bandwidth increases for our choice of duty cycle parameter. 

We summarize here the conditions for convergence of (19), to bring the conclusion of the 
following lengthy calculation: The system uses duty cycle with parameter 9 over coherence 
periods; The first part of (19) converges to Cawgn in the limit of infinite bandwidth, if the 
following conditions take place (end of Section Vn-A.2): 

. ^logL^O 

• 6^ log 14^ ~ const 

The second part of (19) contains the penalty for channel (gain) uncertainty; it converges to zero 
if — > (Section VII-A.l). These conditions can exist simultaneously if 0. 

1) Upper Bound on I{Y]G\X, D): The position of the signal fingers is known as X and D 
are known. 



The first part of (20) is upper bounded by the differential entropy in the case of Gaussian path 
gains. Considering the signals during a coherence period {N transmitted symbols), the discretized 
received signal is composed of NM^. values (chips), where = W{Ts + T^). Given X and 
D, it is known which chips contain signal and which contain only noise (Figure 9). The NMj. 
received values are distributed as follows: 
. N{Mr - L) are HD Gaussian ~ Ar(0, 1). 

• NL values are divided into groups of size A^. Each group is independent of the other groups, 
it has zero mean and its correlation matrix is 



I{Y-G\X,D) 



h{Y\X, D) - h{Y\X,G,D) 



(20) 



/l 







A = 



2P (T, + Td) 
ONqL 



+ 



\ 
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^-Transmitted Symbols 

/ f 



Jj ^ 



Received Signal 

I II I I I I I I I II. I 

TJT. . I \^ 



Fig. 9. The transmitted PPM signal, with guard time of Ta between symbols, and the received signal. 



The differential entropy (in bits per coherence time) is bounded by 

h{Y\X, D) < ^[IMj^ iog,(2^e) + ^ log, {(2nef |A|) 

The determinant | A| is the product of the eigenvalues of A: 1 with multiplicity A'^ — 1 and 1 + 
with multiplicity one 

The second part of (20) is given by 

h{Y\X,D,G) ^^\og, (2ne) 
Combining both parts, and translating to units of [bits/sec]: 

I{Y;G\X,D) [h/s] < ^log^lAI 

9L ^ / £ 
log2 1 + 



2Tc °n L 



= 27;^°s.(^i + ) (21) 

The bound (21) converges to zero as dL — > 0. 

2) Lower Bound on maxg I{Y; X\G, D): This bound holds if the path gains satisfy 
(A) maxi<i<i \ Gi\ in probability as L — > oo, and (B) Eq = E»=i 1 in probability as L — > oo. 
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We first show that the Gaussian distribution Gi ~ N {0,1/L) satisfies these conditions. Condi- 
tion (B) follows easily from the law of large numbers. To prove that condition (A) holds, we 
use the following well-known tail estimate for a standard normal Z and any x > 0: 

P{Z > x)< exp (-a;V2) (22) 



Using /3 = 2. /i^f^ we get 



P (^max \Gi\ > Pj < LP{\Gi\ > P) 

< LP (^\Z\ > /3VT) 

L^/L , , 

V27r log L 
— > as L — > oo 

Clearly /3 — > as L ^ oo. 

Analysis of the Signals in the Receiver: For every symbol, the receiver calculates 

L 

Assuming that xi was transmitted the desired output is Gaussian with 



SI 

-2 



(y1, = Eg 



There are up to L — L Gaussian overlap terms that contain part of the signal (Figure 8). 
Each of these overlap terms can be described by a set OL of pairs of path gains, each index 7o,o 
(between 1 and \TdL\) indicates a path in the channel response. 

OL = h,2) {l\OL\,l, I\Oh\,2) } 

The number of terms in the set may vary in the range 1<|0L|<L — 1 and the indices take 
values between 1 and [T^M^J . The pairs of indices are composed of two different indices, because 
the case where the filter position corresponds to the actual signal position is already accounted 
for in si. 
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Given the overlap positions, or the set OL, the overlap terms are Gaussian with 

|OL| 

E[wiap|OL] = J^^^.i^^^^y^ 
i=l 
|OL| 

£^[«overlap|OL] < ^^1,1^1//^ + ^^ 

i=l 

Assuming a small number of paths, the probability that there are two or more overlaps (the 
set OK has more than one element) converges to zero as the bandwidth increases to infinity, 
see the proof of this convergence in Section Vn-A.3. The assumption on the number of paths 
is satisfied if ^ — > 0. Additional conditions on L, stemming from other parts of the proof, will 
require an even slower increase of L with the bandwidth. 

In addition, there are up to WTg — 1 Gaussian noise terms: 

^[Snoise] = 

^[^noise] = Eg 

For each possible transmitted symbol value, the receiver compares {sj}]^^^ to a threshold 
A — a-sjEjN — a-^ where a e (0, 1). If one output only is above A, the input is guessed 
according to this output. If none of the outputs pass A, or there are two or more that do, an 
error is declared. 

There are three types of error events, and the error probability is upper bounded using the 
union bound: 

P(error) < P(si < A) + (L^ - L)P(soveriap > A) 

+ {WT, - l)P(Snoise > A) 
< <A)+ L2p(Soverlap > A) 

+WTsP{s^oise > A) (23) 

The first probability is bounded using the Chebyshev inequality, and the second and third using 
the normal tail estimate. 
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First Error Event: Recall Si has expectation \/8/N Eq and variance Eq- From the Chebyshev 
inequality. 



2 

P{si<A) < 



iE[si] - AY 

_ Eg 

{Eg - afS/N 

Since a <1 and Eq ^ 1 in probability, for large L the ratio Eg/{Eg — is bounded. Since 
£ / N ^ oo, the probability converges to 0. 

Second Error Event: The probability that an overlap term exceeds the threshold is expressed 
as a sum over the L — 1 possibilities of the number of overlap positions: 

L -f'(Soverlap ^ ^) 

L-1 



^ P (|0L| =t)P (wiap > ^1 |0L| 



i=l 

Section VII-A.3 shows that if the number of paths is such that ^ — > 0, then the probability of 
overlap at more than one position diminishes as W ^ oo. 

P(|OL| > 1) ^ 

In order to ensure that the overlap terms with more than one overlap position are insignificant 
in the calculation of the probability of error, we require ^ — > 0, and then get in the limit of 
large bandwidth 

iv^P(Soverlap > A) ^ P (Soverlap > A\ |0L| = 1) 

The condition |0L| = 1 is omitted in the remainder of the calculation. 

Recall that in the single overlap case Soveriap is normal with mean = GiGm \j£/N and 
variance Eg = J2^i- Hence (sovcriap — lJ)/\fEG is a standard normal. 

By assumption, max|Gj| and Eq ^ 1 in probability, so for L large we can assume 
// < a/2^j£/N = A/2 and Eq < 4. Then 

-P( -Soveriap ^ ^) 

= ^((Soverlap - /^)/v^ > - 

< P((Soverlap ' /x)//^^ > A/ A) = P {Z > A/A) 



February 1, 2008 



DRAFT 



29 



where Z stands for a standard normal. Using the normal tail estimate (22), we obtain 

< exp(2 In L - ^732 - In A/2) 

In order to ensure convergence to zero of this probability, it is enough to have (lnL)/A^ — > 0. 
Recalling A = oi^EjN = n^Jn ^ S^*- equivalent condition: ^InL ^ 0. 

Third Error Event: Recall Snoisc is normal with mean and variance Eq- The third prob- 
ability in (23) is upper bounded using the normal tail estimate (22) for the standard normal 

Z — Snoise/ \/Eg'- 

P(W >A)< (27r)-i/2^/B^/yl)exp(-AV(2EG)) 
W^r,P(snoise > ^) < exp [in {WTs) - A^I{2Eg) - In A] 
The data rate (in bits/sec) is 

ON ON 

log2 {WTs) = — log2 e In {WTs) 

c c 

and the capacity Cawgn — P/Nq log2 e, so 

(CAWGN/i?) H^Ts) = {PT,)/{eNNo) = S/2N 
Since — a'^£/N, we obtain the bound 

iyT,P(snoise > A) < exp [In (WT,) 

-In. ^ 



Since Eq — > 1, the bound converges to as long as > -R/Cawgn- This can be achieved for 
any data rate below the AWGN capacity. 

Achieving Capacity: So far we have assumed a is a constant smaller than 1, so the commu- 
nication system can achieve any rate below Cawgn- The duty cycle parameter 9 must vary as 
j^p^. To achieve asymptotically Cawgn> the parameter a must approach 1 as the bandwidth 
increases, and the following conditions need to be satisfied: 

• {Eg — aY log 1^ — > oo in probability (first error event) 

• {a'^ / Eg) {Cawgn / R) > 1 with probability — > 1 (third error event) 
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The exact choice of a depends on the rate at which Eg converges to 1. 

Summary of the Bound: The system uses IID symbols, a duty cycle 9 and a threshold 
A = a./SjN = a^l^ where a e (0, 1). 

We calculated an upper bound on the error probability 

P 

P(error) < upper bound(VF, L, — , a, 9) 

Nq 

that converges to zero as — > oo if 

• ^ ^ (second error event) 

• 6* log ~ const (to ensure positive rate R) 

• 9 log L ^ (second error event) 

• — > (penalty for unknown gains) 

If — > these the conditions can be realized simultaneously, namely it is possible to choose 
a duty cycle parameter 9 that satisfies all the conditions. 

Note that if the path delays are not known, the additional penalty (5) increases as 9L log W, 
which diverges, so the above proof is not useful. 

3) Estimation of Number of Overlap Terms: The number of possible path positions is — [WT^,] . 
We assume that, over one coherence period, the L delays are chosen uniformly at random among 
the (^^) possibilities. We prove that if the number of paths grows slowly enough, then with 
probability converging to 1 there will be at most one overlap between the set of delays and any 
of its translations. 

Definition 1: For any set 5* C Z and any integer t e Z, we denote hy S + t the translation of 

Shy t: S + t = {s + t\s e S}. 

S corresponds to the received symbol when xi is transmitted, and S + t corresponds to Xt+i. 

For integers 1 < -L < pick a random subset S C {1, . . . , L^n} uniformly among all subsets 
of {!,..., Ljn} with L elements. Let Pl^,l be the law of S; when there is no ambiguity we 
drop the subscripts and refer to it as P. 

Theorem 5: Assume L^/Lm — > as oo, and a set S is chosen according to PLm,L- 

Then Pl„,l(|^ n (5 + t)| > 1 for some t 0) ^ 0. 

Note that t can take both positive and negative values. We emphasize that the theorem says 
that with high probability, none of the translates will have more than one overlap. The proof 
requires the following 



February 1, 2008 



DRAFT 



31 



Lemma 6: Fix t 7^ 0, and let A be a set such that AU {A — t) C {1, . . . , Lm}, and l^l < L. 
Then 

P(A C 5 n (5 + t)) = [L]„/[L^]„ < {L/LrnY (24) 

where a = \Ayj {A — t)\ and [x\a = x(x — 1) ... (x — a + 1). 

Proo/- Clearly A C S n{S + t)is equivalent to A (Z S, {A - t) G S, hence S has to contain 
Au {A — t). Hence a elements of 5" are fixed, while the remaining L — a ones can be chosen 
in ways. The total number of subsets of {1, . . . , L^} with L elements is hence 

The inequality (24) follows easily. ■ 
Note. If A\J {A — t) is not a subset of {1, . . . , L^}, or if \A\ > L, then the probability (24) is 
0. 



We are ready to obtain estimates. Fix i > 0. If \Sr\{S + t)\>2, then Sr\{S + t) must 
contain A — {i,j} for some t + l<i<j< L^. There are (^'^~*) such sets A. Exactly Ljn — 2t 
of them (namely -\- 1} for t -\- 1 < i < Lm — t) have | A U — i) | =3; all the others have 

\Au{A-t)\=4:. Hence 

P(|,5n(,5 + t)| > 2) 

< Yl n{hj}csn{s + t)) 

t+l<i<j<Lm 

< (L„ - 2t){L/L„r + (^•^~ *j (L/L^)" 

The same estimate holds for i < 0. Hence 

P(|5n + > 1 for some t ^ 0) 
< n\Sf^{S-rt)\>l) 

Li 
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and the proof of Theorems 5 and 2 is complete. 



B. When is the Channel Capacity Not Achieved? 

Converse to Theorem 2: PPM systems with a lower bounded symbol time transmitting over 
a channel with Gaussian path gains that are unknown to the receiver, achieve CppM ^ as 
— > oo if j^l^ — > oo. This result holds whether the receiver knows the path delays or it does 
not. 

The signals we consider are PPM with symbol time that may depend on the bandwidth, but 
cannot exceed the coherence period of the channel and cannot diminish (by assumption). The 
symbol time is divided into positions separated by ^. Guard time may be used, no restriction is 
imposed over it, we use Tgymb to denote the overall symbol time, that includes the guard time. 
The signal transmitted over one coherence period is of the form: 

^ VFTsymb Qj^g position of each group of [TgymbW^J 

with n\T^y^y,W\<i<n[%y^y,W\ + \T^y^y,W\-l 



n = 0, 1,..., 



^ symb 



1 (symbol counter) 



other positions 

i = 0, 1, . . . , [TcVFj — 1 (position counter) 

The number of symbols transmitted over a single coherence period is = rJ'" . We assume 

symb 

that A'^ is a whole number, this assumption does not alter the result we prove here. Duty cycle 
or any other form of infrequent transmission may be used over any time period. We analyze 
systems that use duty cycle over coherence periods, because this choice yields the highest data 
rate that serves as an upper bound. The channel is composed of L paths with independent and 
identically distributed Gaussian gains, and delays in the range [0, T^). 

Edge effects between coherence periods are not considered, they may add a complication to 
the analysis, without contributing to the understanding of the problem or the solution. 

Outline of the Proof of The Converse to Theorem 2: The mutual information of the transmitted 
and received signals is upper bounded by the mutual information when the receiver knows the 
path delays. This, in turn, is upper bounded in two ways: the first is the PPM transmitted bit 
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rate, and the second is based on the performance of a simple PPM system with no inter-symbol 
interference. The proof is based on the conditions where the upper bound we calculate on the 
mutual information diminishes as the bandwidth increases. 

Proof: We first point out that the mutual information of a system can only increase if the 
receiver is given information on the path delays: 

I{X-Y)<I{X-Y\D) 

We calculate an upper bound on PPM mutual information with a real Gaussian multipath channel, 
in [bits/sec]: 
Proposition 7: 

1{X;Y\D) [b/s] < maxmin{/im,J2m} (25) 

0<6«1 



W) [b/s] 



^10g2(iyT,y^b) 



T 

^ symb 



h{9) [b/s] = — ^log2 1 + 

•^-^ symb \ 



symb 



^"^log^fl + ^l (26) 



27; V d^oL^ 

Discussion of Proposition 7: The first part of the bound, /i(^), is an upper bound on the PPM 
bit rate for an uncoded system, it is a trivial upper bound on the mutual information. 9 is the 
fraction of time used for transmission, and the bound (25) is maximized over the choice of its 
value. The second part, hid) depends on the number of channel paths L. 

Using Proposition 7, the converse to Theorem 2 follows simply: The bound (25) is positive 
in the limit ^ oo if both its parts are positive. We note that the symbol time Tgymb is lower 
bounded by a constant that does not depend on the bandwidth. The first part, li{0), is positive 
if the parameter 9 is chosen so that ^ log (l^Tgymb) > 0. The second part l2{9) is positive in 
the limit of infinite bandwidth if < oo. If the environment is such that — >^ oo, the two 

log W ' 

conditions involving 9 cannot be met simultaneously by any choice of fractional transmission 
parameter. In this case, the bound (25) is zero in the limit of infinite bandwidth. 

Proof of Proposition 7: The first part of (25) follows simply from the fact that Ii{9) is an 
upper bound on the transmitted data rate. For any choice of fractional transmission parameter 9: 

I{X;Y\D) [h/s] <h{9) [b/s] 
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The second part of (25) is proven by comparing the mutual information of our system, with that 
of a hypothetical system that is easier to analyze. The conditional mutual information I{X; Y\D) 
is upper bounded using a hypothetical system that transmits the same symbols as the system 
we analyze, and receivers them without inter-symbol interference (ISI). This is possible, for 
example, by using many pairs of transmitters and receivers, each pair transmitting symbols with 
long silence periods between them. The transmitter-receiver pairs are located in such a way 
that each receiver can 'hear' only its designated transmitter. This hypothetical system operates 
over a channel identical to the one of the original system. The difference between the original 
system and the hypothetical system is apparent in the number of different noise samples they 
face, the hypothetical system receives more noise, it processes Wfc — WTc'^^^^^^ positions 



per coherence period. In spite of this difference, the hypothetical system can achieve higher data 
rates and its mutual information is an upper bound on the mutual information in the original 
system. We use X and Y to indicate the transmitted and received signals of this system. 



Each received symbol in the no-ISI system is composed of W (Tgymb + 2d) chips, L of them 
corresponding to the channel paths. All output positions have additive Gaussian noise of variance 
one. The mutual information is given by 



symb 



I{X;Y\D) [h/s] <I{X;Y\D) [b/s] 



We now prove that for any choice of 6 



I{X;Y\D) [h/s]<l2{9) [b/s] 



I{X;Y\D) [b/s] 



e - 



H{Y\D) - H{Y\X,D) 



(27) 



We start with the first part of (27): 




H{Y\D) <J2H{nD) <Y.H{Y^ 



i=i 1=1 
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Pi, the probability of receiving signal energy in the i^^ position, depends on the distribution of 
transmitted symbols, but there are exactly L positions in the received symbol the contain a path, 
thus 

W'(Td+Tsy„b) 
1=1 

and each probability value satisfies < pi < 1. 



4 = E 



H{Yi) < Jlog(27re4.) 



- log ( 27re ( 1 + p ^"^-^^y™*^ 



2 ° V V ^N^L 

H{Y\D) < Y.H{yi) 

i=l 

Tc/T,yn,b symbols i=l ^ ^ u / / 

symbols i=l 



2 

Using the concavity of the log we get 



H{Y\D) < log (27re) + ' \ ° '^""^ log 1 + 



^ymb) , 

Now for the second part of (27). For N transmitted symbols, the WTc received values are 
distributed as follows, when the input X and the delays D are known: 

• WTc — NL positions are IID Gaussians ~ N{0, 1). The receiver knows which positions 
contain only noise, and which have signal as well. 
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• The number of positions with some signal is NL. These values are divided into groups of 
size N, each corresponding to a single path. Each group (at known positions) is independent 
of the other groups and its distribution is ~ A'^(0, A) where 



(l 



A = 



2PT. 



symb 







-H{Y\X,D) 



WTc-NL 
log(27rej 



--log((27re)^|A|) 



(28) 



The determinant |A| is the product of the eigenvalues of A: 1 with multiplicity N — 1 and 



(l + ) with multipUcity one 



Simple manipulation yields 



|A| = 1 + 



2/Tgyjnb-^ 
ONaL 



1 + 



2PT, 
eNoL 



-H{Y\X,D) = 



log(27re) 



L ( 2PT, 

log 1 H 

2 ONqL 



We note that this expression depends on SNRestl It is similar to expressions in [3], Section ni.C. 
Combining the two parts into (27) we get 



I{X-Y\D) [b/s] < I{X;Y\D) [b/s] 

= H{Y\D) - H{Y\X,D) 



e_ 



< 



log2 (27re) + )— ^ log2 1 + 



2 



27; 



symb 



2PT. 



symb 



eNoW(Ta + T,y^^) 



L I 2PT 
-log2(2vre)--log2 (^1 + ^ 



9 



2T. 



log2 1 + 



symb 



2PT. 



symb 



9L ( 2PT, 



2Z 
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Note that in the infinite bandwidth limit, if 6'L oo than also 6W ^ oo and l2{0) converges 
to zero: 

w(Ta+Tsymb) 

T fa\ ^ ST^ 2PTsymb 1 (^L 2PTc 



VIII. Conclusion 

This paper revealed the importance of the rate of increase of the apparent number of paths 
as the bandwidth increases. This rate of increase determines the behavior of channel uncertainty 
as bandwidth increases, thus determining the spectral efficiency required of a communication 
system, in order to achieve channel capacity in the limit of large bandwidth. Practical mobile 
communication systems handle channel uncertainty by occasional estimation of the channel, 
usually assisted by pilot (training) signals. The rate of repeating the pilot signal is determined 
by the rate of channel variation and the required accuracy of estimation. This paper showed 
that systems with a low spectral efficiency, and in particular PPM systems, have to sacrifice 
a significant portion of their data-rate in order to obtain channel estimation. When operating 
over difficult channels, namely channels where the number of paths increases quickly with 
the bandwidth, a PPM system has to devote an increasing fraction of its resources to channel 
estimation, until in the limit of infinite bandwidth it cannot communicate. 

The key to understanding the wideband operation over a radio channel is the behavior of 
channel uncertainty as bandwidth increases. The channel model we used is a simplistic one, where 
the channel paths are similar so each represents the same amount of channel uncertainty. Realistic 
channel models are more complex, so it is harder to characterize their channel uncertainty and 
its dependence on system bandwidth. Wideband radio channel models show a spread of the 
impulse response energy over a number of paths, that may not be of equal amplitude. The 
dependence of channel uncertainty on the bandwidth depends on the rate of increase of the 
number of significant channel paths as the bandwidth increases, and we expect similar results 
to ours, where the number of significant paths replaces the number of paths L we used. 
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Appendix 

This section shows that for ED Gaussians {ri}°l_^ ~ A'^(0, |), with the empirical correlation 
defined by: 



C(m, n) 



e 



Kc-1 

E 

i=0 



t—m' i—n 



L L 



2L L'^ - L 



(29) 



We have 

m=l n=l 

We first look at C{m,n) for m ^ n, and use the following inequality, that holds for any 
random variable: 

E\c\ < ^JE [c2] 



m our case: 



Now for the case m — n 



E\C{m,n)\ < ^JE \C{m,nf\ 



E 



Kc-l 



E 



i—m' i—n 



'Kc-1 

E 

i=o 



'^j—mTj—n 



1/2 







E 


/ V i—m i—n 




_i=0 



■1/2 



E [n-mri-n] = E [ri_^] = 



E [rt-m] 



3 



The fourth moment is so because n is Gaussian. 

Using the central limit theorem (holds as n are independent) 



i=Q 



(30) 
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E\C{m,m) - 1 



e 




2 



(31) 



Taking (30) and (31) into (29) gives: 



L L 



5^5]E|C(m,n)-<5, 



m=l n=l 



= LE |C(m, m)-l\ + {L'^ -L)E |C(m, n)\ 



2L L'^-L 
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